Work relations for time- dependent states 
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For time-dependent states generated by an external operation, a generalized free energy may be 
introduced by the relative entropy with respect to an equilibrium state realized after sufficient re- 
laxation from the time-dependent states. Recently, by studying over-damped systems, Sivak and 
Crooks presented a new formula that relates the generalized free energy with measurable thermo- 
dynamic works. We re-derive this relation with emphasizing a connection to an extended Clausius 
relation proposed in the framework of steady state thermodynamics. As a natural consequence, 
we generalize this relation to be valid for systems with momentum degrees of freedom, where the 
Shannon entropy in the generalized free energy is replaced by a symmetric one. 
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Introduction: Over the last two decades scientific ac- 
tivities in non-equilibrium statistical mechanics have dis- 
covered universal relations regarded as extensions of the 
second law of thermodynamics. Examples of such uni- 
versal relations include fluctuation theorems that claim 
identities leading to the positivity of entropy production 
in non-equilibrium steady states (NESS) [iMSl, Jarzyn- 
ski's work relations by which free energy differences are 
estimated in non-equilibrium processes |7H1Q| , and steady 
state thermodynamics (SST) in which state variables are 
defined by (excess) heat or works in NESS 11-23|. 

Recently, for over-damped systems near equilibrium, 
Sivak and Crooks presented a work relation associated 
with a generalized free energy for a time-dependent state 
realized by a finite-speed operation to an equilibrium 
state The free energy they defined is expressed as 

the relative entropy of the probability density with re- 
spect to an equilibrium state realized after sufficient re- 
laxation [25]. Remarkably, when the quasi-static limit is 
considered, a variation of the Sivak and Crooks relation 
(see ([29|) ) becomes equivalent to a thermodynamic rela- 
tion between work and the difference in equilibrium free 
energies. This means that the Sivak and Crooks relation 
is an extension of the second law of thermodynamics. 

A natural question arising here is whether the Sivak 
and Crooks relation is connected to previously known re- 
lations, such as fluctuation theorems, Jarzynski's work 
relations, or formulas proposed in SST. The purpose of 
this Rapid Communication is to find a direct connection 
to previous studies by presenting a simpler derivation of 
the Sivak and Crooks relation. Our re-derivation clearly 
demonstrates that the Sivak and Crooks relation corre- 
sponds to a non-stationary version of the extended Clau- 
sius relation proposed in SST 0,|l8|. Following the idea 
proposed in SST, we successfully generalize the Sivak and 
Crooks relation to be valid for systems with momentum 
degrees of freedom. 

Preliminaries: We study systems consisting of N 
particles under isothermal environment of inverse tem- 



perature j3. Examples of such systems include (i) a 
Hamiltonian system in contact with a heat bath, (ii) 
an under-damped Langevin equation, or (iii) an over- 
damped Langevin equation. The microscopic coordi- 
nates of N particles are collectively denoted by F = 
(ri, . . . , Tat; Pi, . . . , Pat) for Hamiltonian systems and 
under-damped Fangevin equations or F = (ri,...,rAr) 
for over-damped Fangevin equations. For all the consid- 
ered cases, a Hamiltonian Hy{T) characterizes the sys- 
tem, where v represents a set of parameters. For sim- 
plicity, we assume 



(1) 



where F* represents the time-reversal of F defined as 
F* = (ri, . . . , Tat; -pi, . . . , -Pat). (Note that F* = F for 
over-damped cases.) We also assume that an external 
agent operates the system according to a prefixed proto- 
col specified by a function u{t) of t G [0,r]. We fix a 
function u{t) of t G [0, 1] with z/(0) = vq and = i^i, 
by which we have u{t) = y{et) with r = e~^, where the 
typical speed of the protocol is denoted as e. For any 
protocol z>, we define its time reversed protocol by 
i/t(t) = v{l-et). 

Fet F = (F(t))^^[o,r] be a path in a time interval [0,r], 
and F"'" = (F*(r — t))^^[o,r] be the time reversed path 
of F. For the system with z>, we denote the probability 
density of F as 7^(r), provided that F(0) is given. Note 
that the v dependence of T is not written explicitly, but 
the e dependence is shown. For the reversed protocol i)\ 
we express the probability density of F as 7^'''(r). The 
important assumption of our model is that 7^(r) satisfies 
the local detailed balance condition 



-7;(r) e 



r;(ft), 



(2) 



where Q(f ) represents the energy that flows from the 
heat bath to the system in the path F = (F(t))^^[o,r] 
for the protocol z>. In fact, ([2]) is valid for both over- 
damped and under-damped Fangevin equations with the 
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energetic interpretation proposed in Refs. 26|, H^l- For a 
mechanical description of a heat bath in contact with a 
Hamiltonian system, (|2]) is derived in Ref. [28] . Through- 
out this Rapid Communication, the Boltzmann constant 
is set to be unity. 

When the parameter value is fixed as v (that is, v(i) 
is independent of t), the probability density converges to 
the canonical one 



V 



pr (r) = e^(^^-^^(^)) 



(3) 

in the limit t ^ oo, where Fy is the free energy defined 

by 



(4) 



Now, we fix a functional form of the scaled protocol v(i) 
(0 < t < 1) and assume that the system is in equilibrium 
at t = with z/(0) = v^. Let Pe(r) be the probability 
density of the time-dependent state at the end of the 
protocol V. Formally, in terms of the path probability 
measure PF, we express Pe(F) as 



p,(r) = / VY /,-(r(o))7;(f ),5(r(r) - r) 



(5) 



We shall characterize this probability density. 

Let us suppose that the value of v in the system is 
fixed as vij) = v\. The system relaxes from the time- 
dependent state, and the probability density approaches 
the canonical one p^^". We then measure the distance 
of pe from p^^" by the relative entropy P(pe|pJ;^"), whose 
definition is given as 



(r) 



(6) 



for any two probability densities (p{T) and ^'{T). The 
relative entropy has been a useful quantity in the char- 
acterization of the dissipation [io'] as well as in informa- 
tion science [30]. In particular, it should be noted that 
V{p^\p^^^) is connected to a generalized free energy J^{pe) 
defined as 



with 



U{p,) = J dTp,{T)H,{T), 

s{Pe) = - J drp,(r)iogp,(r). 



(7) 

(8) 
(9) 



The calligraphic font used in P, J^, and S represents 
their functional dependence of p^. That is, <S, J-", and 
U are not state functions uniquely determined for v)^ 
and T{pI^^) = Fj, is a function of i^). By direct cal- 
culation, it is confirmed that [25] 
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FIG. 1: (Color online) Schematic of the protocol in (|17p . The 
reverse protocol (solid blue line) is performed immediately 
after the protocol (dashed red line). The work in z> and 
VK^ in are measured. 



For later convenience, we introduce the following no- 
tations. First, for any function /(F) of F, we define con- 
ditional expectations 

(/>r^ = / 5{m - r)r.(f) /(f) (11) 

with a fixed initial state F, and 

r,[f],5(r(r)-r)/(f)p-"(r(o)) 



(/>. 



= / pr- 



Pe(r) 



(12) 

with a fixed final state F, starting from the initial equi- 
librium state pI^^. Similarly, we define 



{f)p^-- = /OTp(r(o))7;[f]/(f), 



(/>;,^: = |pfp(r(o))7;t[f]/(f), 



(13) 
(14) 



which are measured in the protocol and its reversed 
protocol z>^, respectively, for an initial distribution p. 

Sivak and Crooks relation: Let W{T) and VF'''(r) be 
the work done by an external agent with protocols z> and 
0^ in the path F, respectively. That is. 



w{r) := f 
Jo 

Jo 



dt 



dt 



dt 

5F,t(t)(r(s)) 



dt 



(15) 
(16) 



Note that VF'''(f''') = —W{t) along the time reversed 
path Ft. For over-damped cases, Sivak and Crooks have 
derived the following relation |24| : 



In order to obtain {W^y^^^ in experiments, we first per- 
form the protocol z>, and then start the protocol z/t ex- 
actly when z> finishes (without pause). See Fig.[TJ Below, 
we re-derive ([T7j) by using a simpler procedure. 
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Fundamental relations: By using the energy conser- 
vation 

H^Anr)) - ff.o(r(0)) = Q(f ) + W{t), (18) 

we rewrite the local detailed balance condition (|2]) as 

(ft) 



Derivation of Sivak and Crooks relation: In this para- 
graph, we consider over-damped cases (F* = F). By sub- 
stituting (|26|) into (do]), we obtain 



p-"(r*(r))r,t[ft]e- 



Further, by substituting ([25]) into (JSZ}, and by using the 
trivial identity 



where W-.rrit) = W(f) - AF and Wl^it"^) = Wt(ft) 
AF = -Wirr{T) with AF = F^^ - F^^. Integrating ^ 
over all paths, we have a symmetric Jarzynski-type equal- 
ity 



-/5 



-/5 



(20) 



Furthermore, by integrating (p!9]) over paths f that satisfy 
the condition F(r) = F, we obtain the following expres- 
sion for p(.: 



pr(r) 



(21) 



The relations (|2Q]) and (|2T]) are basic equations in our 
derivation. 

To expand the relations ([20]) and ([2T]) in terms of e, 
we prepare the following three estimations. First, since 
VFirr(r) for typical F in the quasi-static limit e ^ 0, 
we assume 



I^irr(F) = 0(e) 

for typical F. Second, for any quantity /(F) 
(^9]) yields 



= inl 



ican V 

^0 



0(e), 
+ 0(e), 



(22) 
0{e% 

(23) 
(24) 



where r(f):= /(ft). 

Now, by setting / = e~^VFirrWirr in (|23)) . we ob- 
tain (H^i„; W^irr)pcan^ = (W^il,; W^ilr>p-"^ + ^(e^), where 
{A;B) = (AB) - {A){B). Thus, the' expansion of ^ 
leads to 



(25) 



Similarly, by using ([24]) in the expansion of ([2T]) . we de- 
rive 



p,(r) = p-"(r)exp 



(^irr)r* 



(W^irr) 



Pi, 



-{Wirr} 



{W%..^-{W^}' (28) 



we arrive at the Sivak and Crooks relation ([T7]) . 

Here, by noting AF = Fy^ -Fy^, ([27]) is further rewrit- 
ten as 



Hp. 



0{elP) 



By combining this expression with ([7]) and ([T8]) . we can 
derive the following relation for the entropy: 



S{pe) - Sy 



O(e'pO) 



This is an extended Clausius relation, because ([30]) leads 
to the standard equilibrium Clausius relation 



Sy. Sy 



(31) 



in the limit e ^ 0. Similarly, ([29]) leads to the standard 
equilibrium work relation in the limit e ^ 0. 

Let us compare ([30]) with the extended Clausius re- 
lation in SST, where it has been shown that heat mea- 
surement enables us to experimentally determine state 
variables for non-equilibrium steady states driven by a 
non-conservative force or by non-equilibrium boundary 
conditions [17]. It is found that ([30]) takes the same form 
as an expression reported in Ref. [17]. (See eq. (11) of 
Ref. [l7|.) This is not accidental. In fact, the derivation 
method of ([30]) or ([29]) is essentially the same as that used 
in Ref. [17]. Furthermore, the Sivak and Crooks relations 
can be easily formulated for time-dependent states gen- 
erated by an external operation to NESS. From these 
considerations, in our viewpoint, ([30]) corresponds to a 
non-stationary version of the extended Clausius relation 
in SST. 

Under- damped cases: Next, we consider under- 
damped systems (F* ^ F). Following the idea proposed 
in Ref. [17], we define the symmetric Shannon entropy 



drp,(r)iog VPe(r)p.(r*) (32) 



and the corresponding free energy 



(33) 



A similar expression was proposed in NESS 3ll, [32|. 



(26) It should be noted that S = S^^"^ and J" = J^^^"^ when 
F = F*. In Ref. [17], the symmetric Shannon entropy 
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was proposed as a new state variable determined opera- 
tionally by measuring the excess heat in the quasi-static 
operation connecting two NESS near equilibrium. Ex- 
plicitly, the symmetric free energy J^^y^ is written as 



/3(^^^-(Pe)-F.J = /^rp,(r)iog^^^p|p^34) 

The right-hand side is not the relative entropy. Rather, 
it can be called "symmetric relative entropy." 

Now, by substituting ([26]) into the right-hand side of 

(|34|) and by extracting the term (Wirr) can vr-(^ilr)r^' 

Pun 



we write 



■T-i- 



+ f ((^irr),e.„^r. +0(e')-(35) 

Here, by setting / = e~^Wirr in (|24|) . we have 
{Wirv)pi^^^T + (^ilr)r*^ = 0{e^), where it should be 
noted that W* = - W^ . We thus obtain 



/ 



drp,(r)((W^i„) _ea„^r. + {Wl)[^) + 0(e3jj36) 



This leads to the cancellation of the second and third 
lines in the right-hand side of (j35j) and yields the result 

(37) 

From this relation, we also find that T in (pT|) and (|29|) 
and S in ([3Q|) are replaced by J^^^"^ and ^S®^"^, respec- 
tively. 

Concluding remarks: As a supplemental claim of this 
Rapid Communication, we explain the inequalities asso- 
ciated with the Sivak and Crooks relation (pT|) . First, by 
recalHng (p!Q|) and applying the non-negativity of relative 
entropy to ([27j) and (pT|) . we obtain 



(H^iL>U<(W^irr),ca„^+0(e3), 



and 



(38) 



(39) 



respectively. These do not appear to be derived from the 
standard second law of thermodynamics. Furthermore, 



^1 t 
1^0 







T T + Tdw 2r-hrdw 



FIG. 2: (Color online) Protocol in t G [0, T + Tdw/2] consisting 
of z> (dotted red line) and a dwell time in [r, r + rdw/2], and 
the subsequent reverse protocol in t G [r + Tdw/2, 2t + Tdw], 
consisting of a dwell time in [r + rdw/2, r + Tdw] and (blue 
solid line). 



we can generalize the inequality (|39]) . Concretely, we 
consider protocols with dwell time Tdw before starting 
the reversed protocol, as shown in Fig. [2j Let p^^^ be 
the probability density at time r + Tdw Since = pe 
and = pIY^j the work (W^)^^dw^ is a generalization 
of the two works, {W^y^^^ and (ly^)pcan^, which appear 
in (pT|) . Now, we present the inequality 



(40) 



for any Tdw ^ '?"dw- "^^^ essence of the proof is to notice 
the monotonically decreasing property of the relative en- 
tropy in relaxation processes (s^, that is. 



(41) 



for any Tdw < t^w- order to utilize this property, 
we define a new forward protocol in the time interval 
[0, r + rdw/2] by combining z> with no operation in a dwell 
time rdw/2, as shown in Fig. [21 For this protocol, we 
consider the Sivak and Crooks relation, and apply (|4T]) 
to the expression of the relation. We then obtain (|4Q|) . 
It should be noted that these inequalities are valid only 
for over-damped cases. 

In sum, we have re-derived the Sivak and Crooks re- 
lation (p!7|) by a simpler argument. We have emphasized 
that the relation is a non-stationary version of the ex- 
tended Clausius relation proposed in the framework of 
SST. By considering a correspondence with SST, we suc- 
cessfully extended the Sivak and Crooks relation to (|37|) 
for under-damped cases. Although these relations are 
valid only near equilibrium, an exact relation can be eas- 
ily derived from ([2T]) without any approximation. The 
next important study will be to demonstrate how these 
relations are useful for understanding non-equilibrium 
phenomena. 

The present study was supported by KAKENHI No. 
23540435 (NN), No. 22340109 (SS), and No. 23654130 
(SS). 



5 



[1] D. J. Evans, E. G. D. Cohen, and G. P. Morriss, Phys. 

Rev. Lett. 71, 2401 (1993). 
[2] G. Gallavotti and E. G. D. Cohen, Phys. Rev. Lett. 74, 

2694 (1995). 

[3] J. Kurchan, J. Phys. A: Math. Gen. 31, 3719 (1998). 

[4] C. Maes, J. Stat. Phys. 95, 367 (1999). 

[5] G. M. Wang, E. M. Sevick, E. Mittag, D. J. Searles, and 

D. J. Evans, Phys. Rev. Lett. 89, 050601 (2002) 
[6] U. Seifert, Phys. Rev. Lett. 95, 040602 (2005) 
[7] C. Jarzynski, Phys. Rev. Lett. 78, 2690 (1997). 
[8] G. E. Crooks, Phys. Rev. E 61, 2361 (2000). 
[9] J. Liphardt, S. Dumont, S. B. Smith, L Tinoco, Jr., and 
C. Bustamante, Science 296, 1832 (2002), 
[10] D. Cohin, F. Ritort, C. Jarzynski, S. B. Smith, L Tinoco 

Jr., and C. Bustamante, Nature 437, 231 (2005) 
[11] R. Landauer, Phys. Rev. A 18, 255 (1978). 
[12] Y. Oono and M. Paniconi, Prog. Theor. Phys. Suppl. 
130, 29 (1998). 

[13] T. Hatano and S. Sasa, Phys. Rev. Lett. 86, 3463 (2001). 
[14] E. H. Trepagnier, C. Jarzynski, F. Ritort, G. E. Crooks, 

C. J. Bustamante, and J. Liphardt, Proc. Natl. Acad. 

Sci. U.S.A. 101, 15038 (2004). 
[15] D. Ruehe, Proc. Natl. Acad. Sci. U.S.A. 100, 3054 

(2003). 

[16] S. Sasa and H. Tasaki, J. Stat. Phys. 125, 125 (2006). 
[17] T. S. Komatsu, N. Nakagawa, S. Sasa, and H. Tasaki, 



Phys. Rev. Lett., 100, 230602 (2008). 
[18] T. S. Komatsu, N. Nakagawa, S. Sasa, and H. Tasaki, J. 

Stat. Phys. 142, 127 (2011). 
[19] G. Verley, R. Chetrite, and D. Lacoste, Phys. Rev. Lett. 

108, 120601 (2012) 
[20] N. Nakagawa, Phys. Rev. E 85, 051115 (2012). 
[21] C. Maes and K. Netocny, arXiv: 1206.3423 
[22] E. Bertini, D. Gabrielli, G. Jona-Lasinio, and C. Kadim, 

arXiv: 1208. 1872 
[23] A. Mounier and A. Naert. larXlv: 1208.4039 
[24] D. A. Sivak and G. E. Crooks, Phys. Rev. Lett. 108, 

150601 (2012). 

[25] B. Gaveau and L.S. Schulman, Phys. Lett. A 229, 347 
(1997). 

[26] K. Sekimoto, J. Phys. Soc. Jpn. 66, 1234 (1997). 
[27] K. Sekimoto, Stochastic Energetics (Springer, Berlin, 
2010), 

[28] C. Jarzynski, J. Stat. Phys. 98, 77 (2000). 

[29] R. Kawai, J. M. R. Parrondo, and C. Van den Broeck, 

Phys. Rev. Lett. 98, 080602 (2007). 
[30] T. M. Cover and J. A. Thomas: Elements of Information 

Theory, 2nd edition (John Wiley and Sons, Now York, 

2006). 

[31] T. S. Komatsu and N. Nakagawa, Phys. Rev. Lett. 100, 
030601 (2008). 

[32] T. S. Komatsu, N. Nakagawa, S. Sasa, and H. Tasaki, J. 
Stat. Phys. 134, 401 (2009). 



